Han Yang

Applications are the foundation of your business. As IT professionals, you need to provide the right infrastructure for these apps to perform as expected and deliver the best experience possible. You know how to do this, you’re good at it. This is your job after all. But when it comes to new types o…

A recent study shows that, up to 85% of trained machine learning models are not deployed. Clearly, there needs to be a close collaboration among data scientists, line of business, IT, and others to ensure that data science projects succeed (instead of being just a science fair project). Yet, we cont…

Is your data pipeline static?  Are you working with only fixed data sources with predictable data ingestion rate? Probably not?  Based on many customer discussions, the data pipeline is constantly changing to accommodate new data sources; hence, the data ingestion rate is often unpredictable.  The o…

In the movie Top Gun, Tom Cruise had a famous line: “I feel the need–the need for speed!” When I talk to data scientists, they often express the same sentiment.  Charged with the responsibility of mining value out of numerous data sources, they often feel that they need ever more…

The Golden Gate Bridge was built to connect San Francisco and Marin County using a suspension bridge over a mile long.  It was built during the Great Depression and took over 4 years to construct with over 1.2 million rivets. When I talk to data scientists and IT teams in the same room, I often feel…

In Part 1 of this blog, I point out that using machine learning algorithms is much easier today with packages such as scikit-learn, TensorFlow, PyTorch, and others. In fact, using machine learning has been relegated down to largely a data management problem and software development issue rather than…

Movies have always created powerful mystique about artificial intelligence. For example,  2001: A Space Odyssey had the computer, Hal 9000, that recognized astronauts, spoke to them, and even locked the door to prevent an astronaut from entering the spacecraft. In the Terminator movies, Skynet was a…

If data is the new oil, then more refining capacity is needed.  Many customers are leveraging the data to be part of the core competitive advantage.   However, refining that data to become valuable, actionable information is difficult. Data collection and preparation take an inordinate amount of man…

If data is the new oil, there is one major difference.  Unlike oil, which over the years have suffered from unpredictable supply, for much of the customers, there is only abundance of data.  Despite the glut of data, the same customers profess there is often a shortage of actionable information.  In…